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SIGNAL PROCESSING BY MEANS OF RESONATORS 
TECHNICAL FIELD 

The invention concerns signal processing systems comprising resonator arrays and schemes 
for signal processing. 

BACKGROUND OF THE INVENTION 

The market of computing expands rapidly in pervasive computing devices (also inferred to 
as tier-0 devices). As these devices wiU be part of almost every aspect of our life, and as the 
functions of these devices wiU become increasingly complex, it is mandatory that the 
interaction between man and machine mimics the ways humans interact with each other. 
Thus there is a need of simple signal processing techniques, e.g., for die processing of voice 
or other audio signals. 

There are many other areas where there is a demand for better signal processing systems. 
Examples are hearing aids, speaker recognition systems, noise suppression systems, and 
systems that allow a speaker to control certain functions of a computer, device, vehicle, 
machine, or apparatus, and so forth. 

Signal processing typicaUy involves filtering of an input signal in the frequency domain. In 
the standard approach, die input signal is first transformed into the frequency domain using 
well known Fast Fourier Transform (FFT) algorithms. In the frequency domain, 
implementation of the filter operation is accomplished by a multiplication of the filter 
response fiinction with the transformed input signal. A filtered time domain output signal is 
then recovered by means of a subsequent inverse FFT operation. Although extremely 
efficient algorithms are known for implementing this approach it suffers from a number of 
ftindamental deficiencies. The FFT transformation is a non-local operation in the time 
domain. This means that an intrinsic time delay is introduced which is inver^tely 
proportional to the frequency resolution of the transfomiation. In order to avoid disturbing 
echoing effects the time delay should typically not exceed lOr' s in audio appUcations which 
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conesponds to a fn^uency lesolution of 100 Hz. at best. In order to achieve sufficient 
fi^uency ^solution for a satisfactoiy synthesis of the filtei^d signal one must r^rt to 
complex phase analysis methods which substanUally increase the computational effort. 

Standard signal processing techniques are computationally expensive and ai^ thus not 
suited for use in voice recognition or speaker recognition as implemented in some tear^ 
devices such as smart cards. 

Similar problems occur in today's hearing aids, where specified spectral regions are 
amphfied. For these applications the time delay is particular detrimental, because he« the 
ongmal and the prx)cessed signal overlap, and thus smear out the subUe time information. 

It is a disadvantage of known systems that the time resolution is not high enough to provide 
reliable cues for use by speech recognition systems. 



processing approach. 



It is an object of the prescm invention to provide an improved signal 

It is an object of the present invention to provide an improved signal pnx^ssing approach 
which is suited for use in hearing aids. 

I. is an object of the present invention to provide an improved signal processing approach 
for use m speech recognition or speaker recognition systems. 

It is an object of the present invention to provide an improved signal processing approach 

for processing acoustic signals. 
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SUMMARY OF THE INVENTION 

deme.,. Md . convoter pn^ran, pTOl„„ as chtaed to the claiim. 

Advanuse. Of u„ ^ ^^^.^^ ^ ^ 

descnplion or are obvious ftom the disclosed. 
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DESCRIPTION OF THE DRAWINGS 



FIG.U 



is a schemauc block diagram of an embodiment, in acconlance with the 

present invention. 



FIG. B is » schen^ac Wod. diag^ of an«her embodiment, i„ accorfa,^ witt 

present invention. 

nClC »»«l»madcblockdiag,amofanoteembodimem.lna«:»W 

present invention. 

FIG. 2 is a schematic flow char, that is used to illustrate aspects of the present 
invention. 



FIG. 3 
FIG. 4 



FIG.S 



shows the hearing threshold of an impaired ear relative to normal hearing. 

is a schematic of loudness growth in norinal (solid line) and impaired (dashed 
line) ears used to illustrate recruitment. denotes the intercept point for 
equal loudness perception of normal and impaired hearing. 

is a schematic that shows the adjusunent of the amplification in a hearing aid, 
according to the present invention, depending on the spectral sound intensity. 

(a) Amplification vs. frequency is equal to the hearing threshold curve of the 
impaired ear for a white noise input spectrum with an intensity of 0 dB 
(hearing threshold for normal hearing). 

(b) Same as (a) but now the input intensity is /> = 50 dB corresponding to the 
loudness of a normal conversation. To account for recruitmem die 
amplification curve must be re-scaled by a factor of ( 1 - P/p^ = o.5) 

(c) The spectral intensity of real sound signals is non-uniform. 
Correspondingly, the scale factor is frequency dependent giving die 
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FIG. 6 

5 FIG.7 
FIG. 8 



curve. 



U a scheoBdc towing of an c.,bo^ „,> ^ ,„ 

the present invention. 

Shows exemplary elements of the unit 6l.i in Rgure 6. 

^an alterative embodiment ofahearing aid usingasetofpseudo-orthogonal 
basu. fimctions which are derived from the z^onator transfonns by means of a 
linear transfonnation. 



FIG. 9 



Is a schematic block diagram of an embodiment of a hearing aid in accordance 
with the present invention. 

FIG. 10 Is a schematic block diagram of another embodiment of a hearing aid in 
accordance with the present invention. 



FIG. 11 



Is a schematic example of a general resonator in accordance with the present 
invention. 



FIG. 12 Is a schematic embodiment, in accorfance with the present invention 

comprising a resonator array with a plurality of resonatonj as shown in Figure 
11. 

FIG. 13A Is a pseudo-code representation of a possible software implementation of a 
general damped (harmonic) resonator array in accordance with the piesem 
invention. 

FIG. 13B is a continuation of the pseudo-code representation of Figure 13A. 
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DESCRIPTION OF PREFERRED EMBODIMENTS; 

ll.eb.ic concept ofU^e present invendon and son. basic te^ 
descnbed m the following. 



are 
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and phase shift) of a resonator. 

TT.er.aremanywaystoreahzea«r.Amechadcalornuc«.n^ham^ 

^^^---Ple'-ightcompriseacavityorhollowbodywhichvibratessyn.patheUc^^^ 

anothervibratingsysten,suchastheair,hroughwhichanaudiowaveistraveling TT^ 
lesonator can also be implen,ented by means of micro-mechanical approaches using 
mechanical resonators such as cantilevers. 

Micromechanical systems comprising cantilevers are well known and easy to make 
Existing semiconductor techmques can be employed. In essence, the techniques of 
15 mK:n,machimng are employed to create cantilever arrays. Details on how to make such 
arrays are described in co-pending patent application PCT/IB95/00817 which was 
published on 10 April 1997 under publication number WO 97/13127 and in co-pending 
patent application PCT/IB96/00636 which was filed on 3 July 1996. Tbe resonance 
frequency of each cantilever of the cantilever array is well defined such that a resonator 
array is obtained which has resonators with well defined Q-factors and i^nance 
frequencies. 

Bridges or membranes can be used instead of cantilever.. It is also conceivable to employ a 
combination of cantilever., with bridges or membranes. 

If a micromechanical resonator array is to be used in connection with an electrical signal 
processing circuitry (e.g. a reconstructor which assigns weights and superposes the 
weighted signals), then the mechanical signals (vibration of the micromechanical 
resonators) has to be transformed into electrical signals. This can be done by means of 
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,0 iboyt^^ co-pe„ji„g PCT applicaion, WO 97/13127 or 
A n«l™ic>l ^ t„ ^ 

capadeon, and b a<Midon. acMvc devices such as MOSFETs drive. 6el» 

™^W.gU„«hoWc.„b«„sed,„a^,i^^g^A^^^^_^ 

fll.era^ Nocks high Se,„e.ciesandanotofi,.ertabk,cfeto«fle,^„cies. If ^cse 

.voiiite..^ coupled in.sUWn«.^o™=ob,ai.safUter,«p„.seii,ncttoo,vhichisa 
«upenx>siUoo of d«= ^sponse function, of u« «vo Blttn. TOs mc,^ 

".gh. have a shape ta, is comparable u, a« shape of a resonMCs «spo.Ke tactton. 

Utewise. resonalors can also be in^u^ h a compu«r system using some suhed code 

that embodies algorithms. 

A resonator can also be realized as a combination of any of the above-descri 

approaches. 

All practical resonators show a loss of energy due to friction (internal or external) or other 
resistance. This is called dampir^g. 7T,e resulting decr^ i„ amplitude of the system is 
known as the decay. The term damping, then, is restricted to the system itself, rather than 
to the sound of the system in an environment. 



Decay is the process whereby the amplitude of oscillation of a vibrating system (such 
lesonator) diminishes with time due to a loss in energy. The loss of energy is what 
usually caUed damping. The decay constant r (also known as decay Ume) is the 
required for the amplitude of a vibrating system to decrease to approximately 37% (or l/e) 
of its initial value. 



asa 

is 
time 
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A„-whenseei„.oUo„ 

integer fracuons (1/2. 1/3. 1/4. ..0. U^eir frequencies of osciU^^^^ 
™.ulUplesofU.l^da.enu..O«,^ 

.ulMesof.he^.^e„^^,,3obeprese„,3ndarecaHedpa„^^^ 
^n..gf^„encies.A^„.orvib.tes.^ 
fi^iuenaes. That is. a resonator has some sort of a filter funcUon. 

TT^ep^nt scheme n^kes use ofthe fact that an aAitnuyUn^edonuunsignal^^^ 
approximated byaUnearsuperpositionofresponsc functions Of .esonators. and in 
particular Urentzian resonators, with r^nance frequencies and Q-factors chosen at will. 

The pn^nt scheme can be realized inacomputing system such that the .«^nse 
^ generated by mm«rical integration of second order diffeienUal equations which are 

associated with the resonators or l^rentzian resonators, llus is numericaUy e^^^^ 
avoids pmblems which are encountered with the FFT approach, namely, time delays can be 
made negligible and the foil spectral infonnation is preserved, viz. there is no limit on the 
fi«iuency resolution. The present scheme is real-time and first results are available hght 
away. TTds is important for hearing aids, for example, where delay leads to echomg. FFT by 
comparison is a global transform approach that provides results with some delay. 

Audio signal processing systems form the basis for signal enhancement and noise reduction 
m a variety of voice related applications, such as speech recognition, speaker recognition 
and voice synthesis. The presem scheme using a resonator array serving as dynamic filter 
array provides a powerful architecture for the implementation of algorithms tfiat closely 
match signal processing in natural hearing and speaking. TWs property is considered to be a 
major innovative step leading to a new class of Audio signal processing systems (audio 
processors) that improve the overall performance of foture voice products. For example, 
speech recognition relies on a front end that transforms the voice signal into a set of 
descriptors (termed cues) of the properties of the signal. The quality of the cues is 
extremely critical for the robusmess of the system in terms of speaker and environmental 
dependencies. The results that can be obtained witi, current systems arc far from 
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U>no,s,«,,i,omnenB...g.,,<>icecon^U>rcommuaicaticn, 



I in cars. 



processing systems. ^ 

Accozdingtothep:^„Unventio„.ani„puuig„alAr.Jis«ceivedviaanta^^^ , and 
analyzed by a signal pn^cessing system 2 using a (damped) resonator an^y 9 as 

-^^^y«'-tratedinFigurelA(notethatthe.canbemo.thanoneilp^^ 

shownmfigu.lCforexample).Tl,esimplestfonnofaresonatoristhatofadamped 
hamonic oscillator, which follows the differenUal equation 

where 5^/; is the response of the i-th resonator and^W is the input signal (e.g., a voice 
input signal). Wt are the resonance frequency of the i-th resonator and r,- is the 
conesponding decay constant. The Q-factor is defined by g = wt/2. 

The resonator can be implemented as an algorithm for digital computers using Verlet 
algorithm, for example, to solve the differential equation for the resonators of anay 9. 

^.•(' + A) = ^i,,(0-^i?.(r-A).^U(,^A)-A(/-A)] (2) 
Where A is the discretization time step. 

20 The frequency response of the damped harmonic o.scilIator is 
A(w) - U + /— ( w7 - s-)} 
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amplitude response decays as 

cm™ speaker al»« ita no« tevcl. TV weighdn, „,.ig^ 
by mea^ of weighdng u„i,s 3, 4. ™d 5. Tl„=se weighOng 3-5 arc p» of a so^ed 
reconstructor 8. 

The weighting ^ay be such that cha^cterisUc speech sounds aie optimaUy separated from 
others and from background noise. Using the weights! response may direcUy identify 
different vowels and classes of consonants. 

15 Likewise, the weights can be constant. Under certain circumstances one or more of the 

weights might even be equal to I, i.e. IV/ = 1. 

A combined signal Qr) is composed by superposing the / weighted resonator signals. In the 
followmg equation the superposition is a summation of the / weighted resonator signals. 



20 



(4) 

The superposition is done by a superposition circuit 6 that is part of the reconstructor 8. 

Note that in the present context the word superposition is used to describe any 
mathematical operation (adding, subtracting, multiplying, dividing, and so on) that is 
employed to process the / weighted resonator signals such that M output signals Qi) are 
obtained, where MeNiin other words A/ = 1. 2, ...). Preferably. M < N. 
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-P«.s^a..P»^™„.^_,^,,,,^^^^^^^____^_^_^^^*^ 
^ Be. ta .he fac. u. ^ 

b^forexa^te«,p,^erorUp,^^f„™,,^,,^^^^^^^^ 
•M^a. cuau™. setecs cemto specOB, fean,^. The advanug. „, to taveofl™ 
to m «s sin,plici<y. iB fle;dbUl.y wio, r=spea ,„ „sol„,io„ which nuy iBelf 

<fcpend o, fte faquency ,=gio^ a„d i„ «arly eUmhuued .ime hg bc««», h,p„, signal 

A(t) and resonator response B(t), 

15 This present methodology can be generalized to resonato,^ having aibitniry response 
fiinctions using other differential equations for the resonator response or their 
corresponding physical implementation. The differential equations are not limited to second 
order. 
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The resonator array may comprise N Lorentzian resonators, or any combination or 
arrangement of K Lorentzian resonators that are comiected or coupled so as to form N 
resonators, or AT non-Lorentzian resonators, or any combination or arrangement of AT 
non-Urentzian resonators tiiat are connected or coupled so as to form N resonators, or any 
combination of Lorentzian and non-Lorentzian resonators so as to form A^resonators (with 
K^^nd K,N^N). Please note that the resonators can be implemented in hardware. 
25 software, or a combination of hardware and software. 

In known FFT-based signal analysis the response time is given by the lowest resolved 
frequency for all Fourier components. With the present scheme, the response time is given 
directly by the decay time r,. which can be selected at will and for each resonator 
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tune resolution is crucial. 

b onto „> b. „ d«ig„ ^ ^ ^ ^ ^ ^ ^ 

- Of U« pa^n^e^ (U U» ™ r^„«,e,, „ ^ „ ^ ^^^^^^ 

1 6 IV fr., 2. ...). Tbese i a™, signals W fed a signal pnx«sing system 16 

Win* eo„^a™„,amy,7a„,a„=const™c.» ,8. Please note ta,u,e system 

of F,g„„ iC i. nK-^generai to U» sywns 2 and ,2 of F,gu«s 1 A and IB because toe 
a«Kinp„sign.is^Wvrid, V^H<U. V.U2. ...).n^v„^^^^^ 

.nd=pem.e„. „ isfore,^,econcei«*leto,UK,ea« Vmic„,b„„eseacl.of wi^ch 
IirovKles an input signal A4t> lo llie system 16. 

TlKre ^ seveml options tt, ge»=™e o, derive Che Z, lime signals P(,). TT^se signals can be 

generated or derived from 

- the input signal(s) A{t) (in a feed forward fashion), 

- the M output signals C(t) (in a feedback fashion), 

- any signal inside the signal processing systems 2, 12, or 16, 

- another signal processing system. 

- another reconstructor, 

- another resonator array, or 

- a computer system. 
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■"d 13B. These Figures comprise comnaiB in b«k«s [ J, 

fl^ .OOP (^.oops^ .30». flnishes a..fe™ee„Lr',37 

*a.»used.odescrtb.*eteh.viora.dp^o,e.ol.„,U«^™,„,, 

Tl.e„ase,o,co„s«„..areCc„U«edU,a.aow«,^„EquaUoa(2)tafl.ef„nn' 

A) = uoMt) + «„,B,('- A) + A) -A(l- A)] (j^, 

■tat desorib« bd«viorof tte respective resoMors. A. U»= «rt o, to ^op 130..3. U» 
anvimdes *. ™d .re Wtulized » ze™. Note ,h« u« E,u«io„ (2a) is ac«.ally so.v«f 
««l«r do™ (i,„licattd by refere«» number 134 in Figure 13B) in *e pseud«ode and 

not inside the first loop 130^131. 

15 Tlus first loop 130-131 is foUowed by a loop 132-133 over time steps TT« stack for input 
signal a (at reference number 135) is reset when rumiing through this loop 132-133 for the 
fust time. This is necessaiy. because the stack 135 would otherwise be undefined. Then the 
difference aprime of the input signal a at two time steps is determined. The resonator 
ampUtudes ft are depending on the actual value of aprime. 

20 If the weights (weight(N)) are constant, then the output signal c can be calculated right 
away by weighing and superposing the individual resonator output signals. If the weights 
(weight(N)) are not constant, then they have to be calculated before weighting acconling to 
same procedure and superposing the individual resonator output signals. Note that in the 
present software implemcntaUon the individual resonator output signals are superposed by 

25 means of adding them. 
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P ^ ^"P"' m is i«:eived. TTus input signal 

signals B,(t).Bj(t)...., 
are 

«^ . xr. *^M/>ror each output siffnalfn 

gene.teN.„dividualweightedoutputsig„als.asindica^i„^,22Asl^^^^ 



/^^/;a«gene«ted(box21,TT.ese^individua,outpu.signaIsB,r,; bT""' 
we^ghtedusingaco^pondingweig...,,, .^^^ 



^.^^W^.T.e weight 

arc«t6togener«teA/outputsignalsGW,C^rA...,C«r.Awith ^ ) 

(s^box23,Pleasenoteti.t in HgurelAthe. is just one output sign^Cr,;p„^^^^^ 
outpmane7,i.e..inthisimple™entauonexamplei»f=l. 

n^genenuionof theA^output signals /.,r.;. i^^,;. .... can either be done con— 
ae..n parallel), or sequentially.Amechanicd^ranaywi* 
w,U pnx^ess the input signaler/; concunently to generate the A^output signal B,U), B^t), 
.... B^t), whereas a computer program implementaUon (such as the one described by means 
of pseudcM^ode) may generate the A^outputsignalsfi,^. B^t). .... fl^,; one after the other 
i-e. sequentially. In the above pseudcK:ode example this is done by means of a loop which ' 
IS run through ATtimes. If the A^outputsignalsB^rr;, B^t), .... B^r; are generated 
sequentially, the respective output signals have to be stored (either before the weighing step 
or afterwards) until all A^output signals arc available for superposition. 

Now the architecture of an audio processor embodiment, based on the r^nator transform 
method, is described. In particular, the present scheme is exemplified using an adaptive 
digital hearing aid as a working embodiment. 

At high frequencies the fiequency resoluUon of the human ear is lower than at low 
frequencies. Correspondingly also the frequency resolution, and with it the spacing of 
resonators of a resonator array, can be matched accordingly, saving computational 
resources, for example. Realization of such an unequal spacing in the frequency domain is 

nontriviaJ in standard approaches. 
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In the following secUon the frequency-dependent signal amplification of hearing aids is 
described. Hearing aids amplify certain spectral regions. Existing technology uses Fourier 
transforms of d« input signal on short time intervals. This technique incorpor^ a fixed 
time lag between input signal and the synthesized output signal, which is inversely 
proportional to the frequency resolution. Fourier transformation requires inherenUy to 
compromise frequency information with time infomiation. This is problematic because 
speech exploits both extreme time and frequency resolution simultaneously. The amplified 
signal is synthesized in the traditional approach from scratch using the Fourier back 
transfonnalion. 

According to the present invention, the audio input signal A(t) is only enhanced using a 
resonator transfomiation. and the frequency information such as the pitch remains fully 
intact, because the resonator oscillates with the same frequency as the audio input sigmil 
m. This approach mimics to some extent the human hearing apparatus. i.e. the cochlea, 
which can be looked upon as a complex resonator array. 

Hearing impairment is characterized by elevated thresholds for the detection of sounds in 
quiet. A typical example for the hearing threshold curve 30 of an impaired ear is shown in 
Figure 3. A prominent characteristic is the steep increase of the hearing threshold above 
200 Hz wid, a first maximum of 50 dB at 1 kHz (reference number 31) and a ftirther 
increase of the threshold in the 10 kHz range. Despite the loss in sensitivity, a sound at high 
intensity might sound equally loud to a hearing impaired listener as it does to a nonnally 
hearing listener. In other words, there is an abnormally steep growth of loudness with 
intensity in the impaired ear. This phenomenon, called lecmitment. is illustrated in Figure 4. 
Because of recruitment. restituUon of impaired hearing cannot be accomplished by , 
of a simple linear filter which compensates the loss of sensitivity of the ear. In order to 
preserve a natural perception of loudness, amplification of the sound intensity at a 
particular frequency must be adjusted acconling to the hearing threshold and according to 
the momentary intensity at this frequency. This process is illustrated in Figure 5. In panel 
(a), a white noise input spectmm with 0 dB intensity is considered, meaning that the noise 
is just at the detection threshold for a normal hearing pei^jon. Note that the curves on the 
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left hana side of r.,^ 5 ^^„. ^ -^^^ ^ 0.^^^ 

niequencies above 1 kHz. 

■0 a „H He,,^ ^„ ^ ^ J 

cmve be seed for cx^ple such fta, *e pe,<«ived loudness ,e«, is 60 dB for a,, 
ta,^es^Bor,,«exan,p,es,„w„i„Pi^3,U«hea,i„gdueshoida, , kHzis«,bou, 
60fflwMcbco„espo„ds.„d»si™uo„depic,ed in Fi8„,.4.F,o„,tt« dashed curve4I^ 
•^"■'-''"-—l^detaU.physiologicH.conee.soundp^isSOdB In 

o.he,worts.an«^McaUo„of30dBiss„flicie...opposed»A.=60dBfor,ow,e«, 
s-gnals. I. follows to, 4e scaling »3nsfo™ado„ for li«ar ,eauta«„ i, , ^^pUcadve 
compression of ihe amplificalion curve according lo 

(3) 

^ P U d» sound pressure Of .he inpu, signal «k1 d,e in«,ccp. poin, 40 (approx. 
100 dB. sec Figure 4) for equal loudness perception „f and n™n,al hearing The 

spec»^<fcuibua„„of.ea,sou«.sig„als(cur.e52,52isno.unifo„„.howe«r<seepanel 
(c) .n 5). Accoriingly, d^e scaling facor varies wid, ftequency. Conespondingly. .he 
shape of U» ampliflcation curve 53 which is adjusted dynamically can deviate suhsandally 
Irom the hearing threshold curve 30 (see Figure 3). 

The ptesent tesonator uat^fonn method is ideally suited for implemendng acousUcal signal 
Vocc^ as i, provides a natural path for implementing fitnctionality which closely 
resembles U« „.y i„ wbich the cochlea of the ear operates, it is to be emphasi^d a, this 
potnt tha, the cochlea does ^ perform a sharp Foxier amdysis of sound signals. 1, is. in 
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^ .^pna« u, .^^^^ coctica as a Of b^d ^ f.„„ ^ ^ 
'o^pen,pUo„isp™p„„i<,„al.„U»U,gadto,„f^p,,3ica,i„«„si^a.,^,,„ 

-^«ac<™p„»,,,^,i,^3„^^.^^.^_^,_^^^^^ 

ys^He„c,..adva«age.s.oe„^,„,Wc^^«o.™i„»,^„;l^ 

''"'^-«-».«.= Q-teorofU,ei„divi*,al«s„„a»«shou.<.bebelo„,OOand 
prfcrabl, bel<» ,0. A s»i,ed ™gc for .he Q-fa«or is , and 5. 

H^«d^b«aheaHagaid«*^„,AbU^diag™n,ofU»sig.a,p™c«s^ 

J»m«,d».ispa„ofd»heaH.g.idissho™i„Hg„.e6.-n»tap„.da»M,„i,/ 
s^eaa, Of , Mi, ^pl, ^ „ , ^ ^ ^ , ^ ^ ^ 

sp^«*a.co„,i„gsig„a,M«i„o^^„aK.Won,.s«,,,Depe„di„,„„«„^^ 
va^ue of .be n^onacor .^sfonm U.c weighs W^„ for U»= resonator aansfon,^ ^ 
-icala^d. Which are .uldplied wid, U» «s„.a.or Won,. i„ d,e device. de„o,«l „i,h 
64.1 - before d» weighs resomitor ttansfom. (he^to refc^d u> as AT individual 
werghW o«p„, signals) are combined i„ d» snpenx»iUon circni, 65 .o forn, d« ootpu. 

«TO In U»prescn,embodi„»,,,„osKp, are involved i„de«nnini„gd,ew«ghB 
>f«. Urn s»p (calcntoUon of fllKr ftaion, d«en„i„es d« relevant sound pressure i„ 
each resonaror ttansfbnn. and fron, du,, d,e opU,™ amp,if,e,,o„ a. Uus 4e,„e.cy Tie 
calculaUonof^enirerfuncioniscarnedoutbynm^Sl., -6,.N. H^n a fi,«r«,„c«„„ is 
synteued by an approxiraaUon ci„n,i, 62 ,o produce an amplifrcadon as given by fte 
astanuneous Ir^y depen^en, ^ ^^^^ ^ ^ 

approximarion cin=„i, 62 evalua»s me weighs WM according ,o Equation (8,. Vniu 
61.1-6I.N and 62 serve Ihe dynamic calculation of W^i). 

m the embodiment of Hgure 6 the resonator tra„,f„m„ ^ ^ 

numcrica, hrtegration of a gencHc differential e,ua,i™, similar or equal to the one given as 

Equation (1). 
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■«ooalor mmfer function being given by EquaUon (3), 

-n-ey tave a consun. Q.,^„, o, 3 and .hei, ^ ^, ^ 

WMalnKara,pe.posi,i„„ofthercsonator.raKforaK 



!5 



C(')=j:H'/(»)B,(() 

(6) 

whe..l„.eig,«^„„^^„^ 

;--'««-....ig„aip^g,^„«,,,,^^^,^^_,,^^ 
^(,„n.„,ve,«.»,ep».F„«„,i„ea*^p,i„gi„^,^„^^^^ 

de.e™.edbyci^«6>.,,6,. «..N, ana second.,, 

a«.'ox,ma,edi„«,app„^Uo„,i^,,2^^^^^_^^^^ 

lea.. »,ua«, m p^ce*^. No.e U„, ,^ ci^i« and oU«r de.«n„ of Fig„„ 6 ™ay 
— = »»w-i»ptemenuUonas™Uasaba„,™.i^,e^^^„,^^, 

CaicniaUon „„he fl,.e,«„eUon by ci„„i. ,UM.2 6,.N is descHbed in conneCo. 

w.* Figu. 7 wiUch sho>™ cxen^a,, 

m« fl-ncta, a meas^ of s„n„d „^ i„ each .esonato, ,^„„n is 
d^em^ed. Tim »=a». sh«dd on d,e one hand .flee, a. sound pressu. over a 

pen-x. Of so™e seconds. On U» o.her hand sudden dses in sound pressu. mus, be de«ted 
so du, d,e sysien, ^ sh„, oiT amplification .^iciciy ,o .«,id dan^ge ,o d« ear. For Uus 
pu^ .he ™ ^ron. is processed by uni. 70 u, ob«in U. in,anai.y signa, 
m. y. ,he siptal /« is spU. in» ,wo signals a. 7. . One of d« signals ,« is pn=cessed 
*ough a resonator 72 that has non-zero damping wiU, a r in d,e range of seconds TWs 

resonau^r 72 is telauvelyslowdantpedt^natorwhichavetages the signal over Ume.T„e 
logandtm Of .he tesult is taken by a uni, 73. The logaridtn, of second pan of the signal 
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-a», ^^^^ ^ ^^^^ Of U„ ™ 
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r.=0.5.(,«„„a«»72)a,,dafas<n,„™„g.«^(^„„,„,^^ ^^^^ 

< 2. < 400% (,«>» U» uucing u„ togariu,™ of ^ a,e„g. »a dicing 0^ av«,ge of 
4. logarito, an, taeqUval™, operadons). The ™™,i„g a«ag« a.e obained by ™^ of 
.«cu:«v.s«™ado.aigonU„„i„.hi^,^^^,„,^^p,^^.^^^__^_^^ 
n»loplied by a wdgh, , w„ ptas „„,pu, of step „ ™,,Upli«, by a weigh, A,^- w , 

wbe,eW,/-/,r„isU«n™berofMepsoverwhichlheaven«i„gisperforme<l Tl^ ' 
«■„ algodte, is d«ag™<, ,0 ,o„„„ f,, instahaneo^ while a. 

U. sa™ „„„ i, ato po^« , ^„ „f ,^ ^ ^ ^^^^^^ 

B,»a,,o„ (5) fte We, ft™:,i„„ Fiu,,)^ ^ „„„ ^ ^ 

itie spectral iMersides </,> using the UaiKformation 

F(ej,) = F(i(a>;)"^i="'"«' 

(7) 

where f .(„,) is ,he hearing threshold of the impaired ear a. a,,. Thus recruitn^nt is 
.nd,«duaily accounted for in each frequency hand that is sanrpta. by the co^sponding 

resonator. 
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lT.edesi«dfUccr.ransferi^ction is defied only at the^^^^^^ 

11>eco.p,etet,a.ferfuncdonisi„terpo.atedusi„gaW 
response functions and imposing the minimization criterion 



^ (j§ QRiiwj)^ -F{wj)y =min 



(8) 



lis 
J ear. 



Il^ema^onproblemissoIveditemivelyusingastandardNev^nalg^^^ 
one atemuon step is perfonned per sampling interval. Note that the filter funcUon is 

contmuouslyupdated during iterBUon. In each itetationstepanewsetofweightsCis 
computed which is used for the synthesis of the output signal (see EquaUon 6). 

Tt. above hearing aid was tested with a test pennon from whom the hearing dueshold 
curve shown in Figure 3 was avaUable. The overall performance was very positive In 
particular, comp^hensibility of natural speech was better than with the test person's 
conventions hearing aid. The test person was able to hear sounds that were not Wn to 
him before. This is an indicaUon that the high fi«,uency gain of standard hearing aids , 
kept rather low on purpose in order to suppress painfully loud sound levels at the < 

An alternative implementation of the adaptive filter (a pseudo-orthogonal basis function 
filter 80) is shown in Figure 8. I„ this Figure an implementation of a hearing aid using 
neariy non-overiaping frequency z^ponses is implemented. By suitable supe^^sition of the 

^sonator transforms in a mixing matrix 83 with weights yvnew resonator 
transforms are constructed, which have a narrower frequency .espouse. The Lot^ntzian 
resonators 82 together with the mixing matrix 83 form a non-Lorentzian resonator array 
As each resulting n^onator transform U) (set of quasi-orthogonal basis functions) is 
localized in a narrx>w frequency domain, the coefficients G in Equation (8) can be taken to 

bcF(a..). Hence, only the filter function needs to be calculated by units81.1-81 Nand the 
synthesis of the filter function is just an identity tiansfomi. 

The basis functions are linear superpositions of resonator transforms 



• * 
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^O.y^^ s^, ta, tt^ h.« a Lo^ ,™ ^ „ u„i,^^ 

M« sy„teis, « Mca-cd abo«=. A. . appn>xmu«io„ of U«= filK, u^t„ 

Wo. by ctanuay 81.1, 81.2 8,.N i, forwd. is a 

l^m^iaoa (performed by s„penx«ita uoi.84) of U„ g,(OwiU, fte weights now 
be«g e,^ „ .iesired a^piificaiio. of u» F&.x a. co™spondi„g ^ance 
*«^-yT^«eigte^,,.„e™.p„^,,^^^^j„^^_^^ 
IS lUusirated in Figure 7. 

We use W = 10 basis functions to implement the adaptive filter for the hearing aid of Rgure 
8. m center frequencies of the basis functions are again logarithmically spaced over a 

fh^uency range from ,00 Hz to 10kHz.Tl,echa™cteristics of the basis functions are as 
foUows: TT.ey have a Lorentzian line shape with a Q-factor of 3 in a fiequency segment of 
07. ± fQ, a very steep gain roll-off of 1 00 dB/decade on the low frequency side, and a 
moderate gain roll-off of 40 dB/decade on the high fiequency side. n,e aggressive low 
frequency attenuation is needed in order to cope with the steep gain profile of the hearing 
curve between 200 Hz and 1 kHz which corresponds to a slope of 80 dB per decade. To 
meet the demanding requirements a large set of M= 100 resonator transforms is needed for 
the synthesis of the basis functions. Simulations show that a value of 3 is agood choice for 
the Q-factor of the resonator transfonns. The corresponding resonance frequencies are 
logarithmically distributed between 100 Hz and 10 kHz in analogy to the basis fimcUons. 

There are various ways to couple the hearing aids, as described above, with the human ear 
One approach is Uiustrated in Figure 9. As shown in this Figure, the hearing aid comprises a 
signal processing system 91. according to the present invention, which receives an input 
signal A(0 (e.g.. an acoustic signal) via input 92. The signal processing system 91 may 
comprise a signal processing system 2 or 12. as illustrated in Figures 1 A and IB. 
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feeds an acoustic signal into the outer ear. 

™y .ine "«''<»^.-«na,sC,(,,OC0.....«0*on.asig„„^,^„ 
.0 sp««, ™p,.„« ^ ^ ,„„^ in *e inn. pa„ ^ ^ 
«8»-..nes .0. .o,heta,p,a„„ .03 such U,., c««in s=g„«„« in ea, .04 

or deaf. Nowadays, in c.„ain cases eiec^ a. e.e„ in,p,an>ed in» u» inner 

->taecU,c«,,acdng*e„e„^„f^^.i,^,^^^^^^ 

be adopw «,ch *a. Signal, on signal Unes .0. an, suited «. stauU«e d« neves 
*r«fly.F<„„^p^,^i„,^^_^^^__^ .OOmaycompdseapnx^sor^M,, 

Pn«sses«» int., Signal CW so as .ogenera^eiecttcalputos Which can be di^cUv fed 

M«imphn,ede.ec«xfcs.-n,ep,ese„,i„ve„Uon helps .oln^^cunen, hearing aids 
because tt p™id«= a n»>» .eliable ami mon= „a«„al way ,„ p™=ess inpn, signals. 

inierfac. ci^iuy „„,y also be „sed ,„ connec. signal p,«x»sing systen. acco^g ,o 
.he presen. invent ,0 a hack end sys«m. such as computer, .elephone systen. hearing 
a.4 speech recogmUon system, speaker recognition system, or a petvasive computing 
*v,ce. for exampte. Tt. interface circuify can he .eali^ by means ofdiscete elements 
" can he integtated into a chip i„„rface citcuitty may comprise a mictoptccessor 
mul-ptexets/demulhplexers. patallel-to-serial convertets. serial..o-pa,allel c„nve,«.,s 
analog/digital conversion circuits, memory, and so fonh. 

rn the p^sent emhodiment of the hearing aid. the chog^tal basis funcUon approach is 
numerically less efficient than the ditect resonator uansfotm method even though no 
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on 



A sp.«h recogniUon ^eo^g „ ^^^^^ ^« „ , ^„ 

s.^a.^«™,kese,o,d«cHp,«.Thi.se,o,ae.Hp».<,esc.b««,I 
cha^^rt^ic Of .he voioe signal (tap„, ^, 

m«h,„g se, „,d«crip»,s of fc„„d i„ daubase. .b. con^po^,. ,o„„ 
™. syoab,., o, „ort ^ ^ 
speech .^ogaitio, ^ U,a„ u„ o« of taown sya^s. 

A sp^ic, recojnito sya™ is a systtn, which Is used ,o itotiiy a sp«to by iB voice 
n. ,s ,npo™, for systems whce some ide„.f,cado„ of U» user is ,e<,„i,ed. Examples 
are acce.» syslems. automated teller machines, and the like. 

The. is also a demand for acoustic detectots which an= designed to detect a pa,«c„lar 

no,seor^„d.S„chade.ec.orcou,dforexamp,ebeu,,edtoindicatewhetheranengi„eis 
about to be destroyed, or to detect acoustic signals which can otherwise not be detected by 
.he human ear. In noisy environment, e.g. ,n a cockpit, it would be useftti ,„ or 
el.m,„„e noise so as to ensute that voice and other signals can be better undet^tood. Such 
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si"peiI)ositioi.oftheoutpulsiEnalr/,..».,i . = "»"BP«lar. The 

.0 --'--'--.p- 



5 



* (.0, 



(II) 



fb^artcd .0 a,eco„s.™or ,21. TOs ■«o„s.™c.o, p«,vi,^ ^^^^ ^ 
»upe.p«„Uo„ of *e signals such .ha. M ou,p„, signals a.) ^ oWned. 

M n»„.i„^ fa«h„ ahove. ^ ^ can used f.. ^ p^,„, ^ ^ 

of signals, a signal p^cessing s,s,en, acco^ng ,o ,he p,^., i„„„,„„ ,„ 
openue on elecWcal signals ami i,a„ ,c„„s,ic signal is reived, to so™ s„„ of 
^c^phone of o-hern^ans for .™sfo™a,i„„ of d« acoustic signal inlo an eleCcal signal 
fo™, „ ^uned. A microphone is an c,ec,„.cous,ic ,™sduccr which convex va.a.ions 
m sound p,essu„ inu, an equivalcn, electrical signal, which .hen is fed lo ,he signal 
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p™c«a„g system Kcortingio the prese„,i.vM,too. 

«.y language, code or .oMo„. of. se. of i„«™c,io.s m,^i »> cose „y«m hevtag 
"n rnfon-aion pressing cpabili-ytoperfom, a pa«icuIarfUncdon.i*erdi,ccUyorafler 
..teorbod, Of .be following a) conve^„„ ,o anoU« language, code or „«aUo„; b) 
reproduction in a different material form. 



